TABLE 5    An Evaluation Succession for Program Research and Development
Stages in Program Stages       Element Development
Ways of Knowing
Validity Concerns
Selection Pressures
Step 1. Initial selection: values, theories, goals, and objectives
1                Step 2. Treatment, independent
variable formation
2               Step 3. Decision point: review,
evaluate, translate; proceed, recycle
3               Step 4. Program element
formation
Step 5. Decision point: review, evaluate; proceed, recycle
Qualitative/personal
Experimentation: true or quasi
Qualitative/personal
Experimentation: true or quasi
Qualitative/personal
Construct and external
External-internal or internal-external
Construct and external
External-internal
Constructive and external
Step 6. Program element implementation Step 7. Decision point review, evaluate; proceed Step 8. Full-scale program clement operation	Data guidance Qualitative/personal Program evaluation	External-internal Construct and external Internal and conclusion, statistical
Does the idea have potential?
Are the relationships of enough magnitude?
Can treatments/independent variables be translated into stable, program element(s)?
Does it work in the setting employed?
Is it worth further work?
Can it be improved with tinkering?
When and if in or out of the program?
Does the program element, with other elements in association,
bring benefit ?n iterative fashion, these developmental cycles are performed until a program is achieving its intended goals or until it seems evident that the goals cannot reasonably be attained.
